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SECTION  I 
INTRODUCTION 

Avionic  systems  are  customarily  tested  in  radiation  and  other  environments 
to  determine  susceptibility  of  electronics  to  failure  due  to  those  environments. 
Often,  few  samples  are  available  for  testing  other  than  the  field  hardware 
itself,  and  this  cannot  be  allowed  to  suffer  significant  degradation  in  such 
tests  and  then  be  returned  to  operational  use.  The  question  has  long  existed 
whether  radiation  reduces  reliability.  An  opportunity  to  gain  insight  into 
this  question  appeared  when  ten  flight  hardware  guidance  and  control  systems 
were  withdrawn  from  service  inventory,  tested  in  a  bremsstrahlung  environment, 
and  returned  to  service. 

Radiation  can  imnediately  degrade  circuit  reliability  by  such  effects  as 
photocurrent  induced  latchup.  The  original  purpose  of  these  tests  was  to 
determine  the  susceptibility  of  the  tested  electronics  to  this  kind  of  irmedl- 
ate  degradation  of  reliability.  It  is  not  the  purpose  of  the  present  report 
to  comment  on  such  immediate  effects  of  radiation;  this  subject  is  reported  in 
numerous  other  sources. 

In  testing  for  such  immediate  effects,  however,  even  at  relatively  low 
doses  and  rates,  there  is  some  risk  of  permanently  degrading  the  circuit 
reliability  in  ways  which  are  not  obvious.  Examples  are  thermomechanical 
weakening  of  bonds,  and  damage  to  power  supplies  and  other  peripheral  circuitry 
as  a  result  of  temporary  current  overload.  The  present  report  is  intended  to 
indicate  whether  radiation  testing  affects  mid-1960s  junction  isolated  SSI 
(small  scale  integrated)  circuitry  via  these  longer  term  mechanisms,  assuming 
the  imnediately  obvious  effects  of  the  radiation  have  been  corrected. 

Since  detailed  records  were  kept  on  the  hours  in  service  and  failures 
suffered  in  several  levels  of  the  substructure  of  the  systems,  an  opportunity 
was  available  to  monitor  any  change  in  long  term  reliability  resulting  from  the 
radiation  tests.  Following  six  years  of  observations,  comparisons  were  made  to 
determine  if  a  larger  failure  fraction  had  occurred  among  the  irradiated 
systems  than  among  identical  nonirradiated  systems. 
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SECTION  II 

IRRADIATION  AND  DATA  COLLECTION 

Ten  operational  guidance  and  control  systems  taken  from  the  field  were 
exposed  to  bremsstrahlung  from  the  Pulserad  1590  machine  located  in  the  Tran¬ 
sient  Radiation  Effects  Facility  at  the  Air  Force  Weapons  Laboratory.  The 
bremsstrahlung  spectrum  of  the  machine  is  assumed  to  be  equivalent  to  monoener- 
getic  photons  of  4.2  MeV  (Ref.  1).  A  more  detailed  description  of  the  output 
spectrum  of  the  Pulserad  1590  is  available  from  tests  which  were  performed 
several  years  ago  by  the  US  Army  Electronics  Command.  A  report  on  their  results 
has  recently  been  released  (Ref.  2),  Their  calculated  spectrum  is  included  as 
appendix  C. 

Each  of  the  ten  systems  was  irradiated  in  eight  to  ten  pulses,  the  average 
half  power  width  of  each  pulse  being  about  72  ns.  The  systems  were 
rotated  between  pulses,  so  that  the  average  total  dose  was  approximately  1800 
rads(Si),  The  average  (over  all  modules)  maximum  half-power-point-rate  was 
about  8.4E9  rads(Si  )/sec.  The  systems  were  then  put  back  into  operation  and 
moni tored. 

The  smallest  traceable  serialized  unit  within  the  system  is  the  module.  A 
module  consists  of  an  average  of  about  25  junction  isolated  small  scale  inte¬ 
grated  circuits,  45  discrete  semiconductor  devices,  and  miscellaneous  R,  L,  and 
C  components.  If  a  transistor  fails,  the  serialized  module  that  contained  the 
faulty  transistor  is  removed  and  replaced  with  an  operating  module.  The  module 
that  failed  is  sent  to  a  repair  depot  where  the  problem  is  diagnosed  and 
corrected.  The  module  is  then  ready  for  reinstallation  in  that  or  another 
system.  Removal  and  repair  of  these  serialized  modules  is  recorded  along  with 
operating  time  preceding  failure.  Record  is  also  made  of  periodic  operational 
checks  of  all  system  modules.  These  records  supply  the  information  on  the 
modules  necessary  for  the  analysis  reported  herein. 
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To  ensure  that  radiation  was  the  primary  cause  of  failures  and  not  manufac¬ 
turing  or  assembly  defects,  a  set  of  modules  was  required  as  a  control  group. 

Two  control  modules  were  used  for  each  irradiated  module,  one  with  a  serial 
number  (SN)  immediately  above  that  of  the  irradiated  module  and  the  second  with 
SM  immediately  below.  To  obtain  both  the  plus  one  and  minus  one  serial  numbers 
from  the  irradiated  module  would  be  the  ideal  case,  but  this  was  not  always 
possible  (see  below).  Modules  as  close  to  the  irradiated  modules  as  could  be 
found  were  used  as  controls  to  provide  some  assurance  that  an  irradiated  module 
and  its  nonirradiated  controls  were  assembled  at  the  same  time,  under  the  same 
conditions,  and  with  electronic  components  from  the  same  stock.  More  important, 
however,  is  that  the  irradiated  module  and  its  corresponding  control  modules 
were  placed  into  service  at  the  same  time.  Therefore  it  is  likely  that  the 
irradiated  and  control  module  groups  would  have  a  nearly  equal  average  number 
of  operational  hours,  and  any  explanation  for  difference  in  failure  rates 
between  the  two  groups  would  not  include  module  age. 

All  failures  discussed  in  this  report  are  primary  failures.  Primary  failures 
are  those  in  which  a  module  develops  a  defect  and  fails  of  its  own  accord.  If 
a  module  failed  as  the  direct  result  of  a  failure  in  another  module,  it  was 
called  a  secondary  failure  and  was  not  included  in  this  study. 

Computer  printout  of  failure  and  repair  summaries  provided  the  irradiated 
and  control  module  data  for  analysis.  The  printout  included  module  type,  serial 
number,  guidance  system  location,  month  installed  and  removed  since  irradiation 
in  1969,  total  hours  used  since  1969,  number  of  primary  failures  per  module, 
the  hours  each  module  operated  since  those  failures  were  repaired,  and  diag¬ 
nosis  of  primary  failure. 

The  printout  contained  a  total  of  650  irradiated  modules.  This  represents 
82  percent  of  the  total  number  of  irradiated  modules.  The  remaining  18  percent 
were  discarded  because  records  of  the  modules  could  not  be  found  or  the  records 
were  incomplete.  Given  650  irradiated  module'  in  the  printout,  one  would 
expect  1300  nonirradiated  controls  (a  prior  and  a  post  SN  for  each  irradiated 
module).  Actually,  there  were  only  1044  control  modules.  This  happened 
because  quite  often  two  or  three  modules  were  irradiated  with  consecutive  serial 
numbers;  for  example,  modules  numbered  5,  6,  and  7.  The  nonirradiated  control 
for  this  group  would  be  modules  4  and  8.  Although  six  control  modules  would 
normally  be  expected  for  three  irradiated  modules,  in  this  case  there  would  be 
only  two. 
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SEaiON  III 
ANALYSIS 


The  data  in  the  printout  was  first  edited  to  eliminate  possible  gross 
anomalies  due  to  record  keeping.  All  the  remaining  modules  were  divided  into 
three  subcategories:  power,  logic,  and  analog  modules.  The  result  is  summar 
ized  in  Appendix  A.  In  Appendix  B  are  given  the  results  of  chi-squared  (x*) 
and  small  sample  statistical  analysis  of  this  data. 


The  hypothesis  tested  was  that  the  incidence  of  primary  failure  is  independ¬ 
ent  of  test  irradiation.  This  hypothesis  was  chosen  because  it  was  easy  to 
compute  expected  values  given  independence  between  failures  and  irradiation. 

As  an  example,  following  is  a  calculation  of  the  expected  number  of  irradiated 
module  failures  in  the  power  subset,  assuming  this  independence.  The  numbers 
for  computing  this  and  all  other  expected  value  calculations  are  given  in  the 
module  data  sheet  (Appendix  A).  To  be  assured  that  the  x*  test  will  yield 
valid  results,  each  expected  value  should  be  at  least  five. 


E-^  =  expected  number  of  modules  that  were  irradiated  and  failed 

=  (fraction  of  modules  irradiated)  x  (fraction  of  modules  that  failed) 

X  (total  nuirber  N  of  modules) 

total  number  modules  failed  ^  total  number  modules  irradiated  ^ 

N  N 


=  201 
513 


X  X  513 
513 


=  6.269  .  (Observed  value  was  7,  See  Appendix  B,  Table  3.) 

The  four  expected  values  in  the  2  x  2  matrix  (success-failure  versus  irradiated- 
nonirradiated)  were  then  combined  with  the  values  actually  observed  to  form  the 
X^  statistic,  using  the  following  formula: 


where  D  is  observed  data  value;  E  is  expected  value;  and  N  is  total  number  of 
modules  for  that  test.  This  experimental  value  for  x^  is  then  compared  with  the 
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statistically  significant  value  Xq  (read  from  widely  available  tables): 

Xi  =  3.84146 

°  d.f.  =  1 
a  =  .05 

where  d.f.  =  degrees  of  freedom  and  a  =  level  of  significance.  For  more  infor¬ 
mation  on  chi-squared  testing,  consult  an  introductory  statistics  textbook. 

Results  of  the  x*  tests  show  that  the  data  for  the  set  of  all  modules,  and 
also  for  the  power  subset,  were  not  sufficiently  significant  to  justify  reject¬ 
ing  the  statistical  hypothesis.  That  is,  the  printout  does  not  supply  sufficient 
evidence  to  conclude  that  the  test  irradiation  affected  the  probability  of  pri¬ 
mary  failure.  To  say  that  this  data  shows  that  test  irradiation  does  not  affect 
the  probability  of  primary  failure  would  be  a  stronger  statement.  This  stronger 
statement  entails  the  risk  of  a  Type  II  error  (accepting  a  false  hypothesis). 
Nonetheless,  the  test  statistics  show  x*  «  Xo»  therefore  it  appears  this  stronger 
conclusion  is  also  warranted  by  the  data.  The  same  conclusions  follow  from  small 
sample  analysis  of  the  logic  and  analog  subsets. 

It  will  be  noticed  that  the  statistical  tests  used  were  simple,  i.e.,  did  not 
include  such  relatively  sophisticated  statistical  analysis  as  Wilcoxon  rank  sum 
tests.  The  reasons  for  this  are  as  follows.  Although  the  expected  failure  values 
were  small,  they  were  adequate  for  x*  testing  both  the  modules  as  a  single  class 
and  the  power  subset.  Also,  small  sample  techniques  were  adequate  for  analysis 
of  the  logic  and  analog  subsets.  As  to  paired  comparisons,  such  as  time  rank 
sum  tests,  it  was  intended  that  the  correlation  between  failure  rate  and  component 
age  or  production  run  was  to  be  considered  only  if  the  data  seemed  to  indict 
radiation.  Age  or  production  run  could  then  be  studied  as  an  alternative  expla¬ 
nation  for  failure  so  that  radiation  would  not  be  blamed  falsely.  Since  simple 
tests  appear  to  exonerate  radiation  immediately,  there  was  no  need  to  use 
further  statistical  tests  to  be  sure  radiation  is  not  being  credited  with  causal 
effects  when  that  credit  belonged  elsewhere. 

Mean  time  between  failure  (MTBF)  rates  could  not  be  estimated  accurately 
for  either  the  irradiated  or  the  control  groups.  Due  to  high  reliability 
electronic  parts  used  in  these  guidance  and  control  systems,  only  about  2 
percent  of  the  modules  failed.  If  a  substantial  percentage  of  the  modules  had 
failed  at  least  once,  it  could  be  assumed  (for  computing  purposes)  that  the 
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remaining  modules  failed  at  the  end  of  the  period  of  observation,  usina  the 
total  number  of  hours  given  in  the  printout  for  the  time  to  failure.  This 
would  yield  a  lower  bound  on  the  ffTBP.  With  a  substantial  number  of  failed 
parts,  one  might  also  be  able  tc  extrapolate  the  MTBF  using  distributions 
applicable  to  semiconductor  failure  rates.  But  such  a  substantial  failure  rate 
did  not  occur.  Even  if  enough  module  failures  had  occurred,  a  second  problem 
hinders  MTBF  calculations.  The  data  for  both  the  irradiated  and  nonirradiated 
modules  included  only  those  hours  of  operation  accumulated  since  1969  (date  of 
irradiation).  Records  would  have  to  be  accessed  to  recover  the  module  pre¬ 
irradiation  hours.  If  those  hours  were  not  included  and  the  modules  were  in 
the  field  an  average  of  2  years  before  irradiation,  then  the  calculated  MTBF 
data  would  be  25  percent  low,  since  only  6  of  the  8  years  of  life  would  be 
included.  Therefore,  to  determine  MTBF,  both  the  pre-irradiation  hours  and 
many  more  module  failures  are  needed. 
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SECTION  IV 
CONCLUSIONS 

Because  no  failure  fraction  Increase  due  to  radiation  was  observed,  we 
conclude  the  ten  systems  have  suffered  no  long  term  reliability  degrada¬ 
tion  since  they  were  irradiated  in  1969.  Several  considerations  must  be  kept 
in  mind  when  accepting  the  statement  that  the  test  radiation  did  not  affect 
the  failure  fraction.  The  systems  were  irradiated  with  bremsstrahlunq  (average 
energy  about  4.2  MeV).  Testing  with  a  different  spectrum,  with  a  neutron 
source,  or  with  different  dose  or  rate  levels  might  produce  different  failure 
records  and  correlations.  To  make  MTBF  estimates,  the  modules  will  have  to  be 
monitored  for  several  more  years  to  see  if  enough  failures  occur. 
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APPENDIX  A 

SUMMARIZED  MODULE  PRINTOUT  DATA 


No  primary 
fai lure 

Primary 

failure 

Not  irradiated 

1024 

20 

1044 

Irradiated 

637 

13 

650 

1661 

33 

1694 

No  primary 
fai  1  ure 

Primary 

failure 

Not  irradiated 

303 

9 

312 

Irradiated 

194 

7 

201 

497 

16 

513 

No  primary 
fai  1  ure 

Primary 

failure 

Not  irradiated 

444 

7 

451 

Irradiated 

269 

3 

272 

713 

10 

723 

No  primary 

Primary 

fai lure 

failure 

Not  irradiated 

277 

4 

281 

Irradiated 

174 

3 

177 
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APPENDIX  B 

LONG  TERM  FAILURE  FRACTION  STATISTICS 


^^.E^ected 

Observe^^ 

No  primary 
failure 

Primary 
fai lure 

_^202^6623 

^^^20^37662 

Not  irradiated 

1024 

20 

1044 

33766 

,^4^62337 

Irradiated 

637  ^ 

13 

650 

1661 

33 

1694 

Tabk»  2.  Overall  Observed  and  Expected  Module  Data. 


X 


2 


(y;i^  V  f4  *  1024.3378 
\  E/  19.667944 

636.66251 
t  13.346667 

1694.014921 

-1694.000000 

.014921 


Comparing  i«tth  xi  -  3.84146  shows: 

a.f.  »  1 
a  *  .05 

Test  is  not  significant,  i.e.,  data  does  not  provide  sufficient  reason  to 
reject  the  hypothesis  that  failure  is  independent  of  whether  or  not  irradiated. 
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Table  3.  Power  Subset  Observed  and  Expected  Module  Data. 


513.1446597 

-513.0000000 

.1446597 


=  303.73276 

8.3239183 
193.27175 
+  7.8162314 


which  is  less  than  3.84146. 

Therefore  the  data  does  not  provide  sufficient  reason  to  reject  the  hypothesis 
that  failure  is  independent  of  whether  or  not  irradiated. 


Logic: 


The  expected  (under  the  hypothesis  of  independence)  number 

of  primary  failures  among  the  irradiated  items  is 
272*10 

jg-j—  =  3.76.  Since  this  is  less  than  5,  we  do  not  have 
enough  data  to  perform  a  x*  test  in  this  set.  Therefore 
we  instead  perform  the  following  small  sample  test  of 
independence: 

P  (3  or  fewer  irradiated  |  10  drawn  from  723,  of  which 
272  irradiated  and  451  not  irradiated) 


^  (t)  (?§!,) .  M  . 


24  >  .05 


■ 
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Therefore  the  data  does  not  provide  sufficient  reason  to 
reject  the  hypothesis  that  failure  is  independent  of  whether 
or  not  irradiated,  at  the  5%  level  of  significance  for  snail 
samples. 


Analog: 


The  expected  number  of  failures  among  the  unirradiated  is 
4.29  and  among  the  irradiated  is  2.71.  Since  both  are  less 
than  5,  we  do  not  perform  a  x*  test  on  this  set  either.  The 
small  sample  test  yields: 

P  (3  or  fewer  irradiated  |  7  drawn  from  458,  of  which 
177  irradiated  and  281  not  irradiated)  ■ 


,  /l77\  /28l\  /■ 

_  I  i  /  \7-i/  .  I 

■  A  /45  m  - 

1*0  I  ,1 


m 

28l\ 

1 

) 

.29  >  .05 


Therefore  the  data  again  does  not  provide  sufficient  reason 
to  reject  the  hypothesis  that  failure  is  independent  of 
whether  or  not  irradiated  at  the  5%  level  of  significance  for 
small  samples. 
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APPENDIX  C 

PULSERAD  1590  OUTPUT  SPECTRUM 
(This  is  Figure  14a  in  reference  2.) 


(«l!>n  •  *»!*"»**! 
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Figure  1.  BreTSstrahlung  Energy  Spectra  at  Element  Centers. 


